WHAT IS CLAIMED IS: 
^MbOj\l . An image pickup method of synthesizing a plurality of images acquired 

by sensing an object under different exposure conditions to produce a single image 
excellent in gradation reproducibility, the method comprising the stepsof: 

sensing an object under different exposure conditions to acquire a plurality 
of images; 

compensating the levels of the plurality of images on/fie basis of the 
exposure conditions under which they have been sensed^espectively, to provide a 
5 plurality of compensated images; 

Eh synthesizing the plurality of compensated images to produce a single 

r° compressing the synthetic image to an extent depending upon the 

fU performance of its output destination to produce a compressed image. 

? 2. The method as set forth in Claim 1 , further comprising the step of 

^ subtracting from the pixeHevel of each of the plurality of images a positive value 

given based on the exposure condition under which each of the images has been 

sensed to produce/fhe compensated image. 

3. The method as set forth in Claim 2, further comprising the steps of: 
calculating a mean pixel value of each of the plurality of images; and 
multiplying the mean pixel value obtained at the mean calculating step by a 

factor /et based on the exposure condition to calculate a positive value. 
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4. The method as set forth in Claim 3, further comprising the steps of: 
time-smoothing the positive value obtained at the multiplying step; and 
subtracting the time-smoothed positive value from the pixeUevel of each of 

the plurality of images. / 

5. The method as set forth in Claim 3, wherein the factof is set larger for the 
image having been sensed with a larger exposure at the image sensing step. 

6. The method as set forth in Claim 2, further comprising the steps of: 
filtering the signal of each of the plurality/5f images by a predetemuned low- 
pass filter; and / 

multiplying an output obtained at dafe filtering step by a factor set based on 
the exposure condition under which th/image has been sensed to calculate a 
positive value. / 

7. The method as set forth jto. Claim 6, further comprising the steps of: 
time-smoothing the positive value obtained at the multiplying step; and 
subtracting, at the/Subtracting step, the positive value obtained at the time- 
smoothing step fronyhe pixel level of each of the plurality of images. 

8. The method^s set forth in Claim 6, wherein the factor is set larger for the 
image having b/en sensed with a larger exposure at the image sensing step. 

9. The nriethod as set forth in Claim 1 , wherein each of the plurality of images 
acquired /t the image sensing step is an image signal in which a frequency- 
modulated color signal is superposed on a brightness signal, the method further 
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comprising the step of separating the image signal into the brightness and color 

signals; and / 

the brightness signal and color signal separated at the signal separating step 

being compensated at the level compensating step to produce a compensated 

brightness signal and a compensated color signal, respective}?; 

the compensated brightness and color signals being synthesized at the image 

synthesizing step to produce a synthetic brightness sjgnal and a synthetic color 

signal, respectively; and / 

the synthetic brightness and color signals being compressed at the image 
compressing step to produce a compressed brightness signal and a compressed 
color signal, respectively. / 

10. The method as set forth in Claim 9, wherein at the level compensating step: 
a compensation amount is calculated based on the brightness signal 

separated at the signal separating step; 

the level of the brightness signal is compensated with the compensation 
amount to produce a /Compensated brightness signal; and 

the compensated color signal is produced based on the compensated 
brightness signal. 

1 1 . The inethod as set forth in Claim 9, further comprising the step of mixing 
the comp/essed brightness and color signals. 

12. An image pickup method of synthesizing a plurality of images acquired by 
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sensing an object under different exposure conditions to produce a single hfiage 
excellent in gradation reproducibility, the method comprising the steps/f: 

sensing an object under different exposure conditions to acqijire a plurality 
of images; 

synthesizing the plurality of co1 : npensate^ii'nages to pr/duce a single 



synthetic image having a wide dynamic range; 

compressing the dynamic range of the synthetic image to an extent 
depending upon the performance of its output destin/tion to produce a compressed 
image; and 

compensating the level of the compressed image to provide a compensated 
compressed image. 

13. The method as set forth in Clair/12, further comprising the step of 
subtracting a predetennined positive value from each pixel level of the 
compressed image to produce the compensated compressed image. 

14. The method as set forth in Claim 13, further comprising the steps of: 
filtering the signal/f the compressed image by a predetennined low-pass 

filter; 

normalizing an output value obtained at the signal filtering step; and 
multiplying the output obtained at the normalizing step by a predetermined 
factor to calculate a positive value. 

1 5 . The jfiethod as set forth in Claim 14, further comprising the steps of: 
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time-smoothing the positive value obtained at the multiplying step; and 
subtracting, at the subtracting step, the time-smoothed positive value from 
each pixel level of the compressed image. / 
16. The method as set forth in Claim 12, wherein each of the plurality of images 
acquired at the image sensing step is an image signal in which a frequency- 
modulated color signal is superposed on a brightness signal, the method further 
comprising the step of separating the image signal info the brightness and color 

signals; and / 

the brightness signal and color signal separated at the signal separating step 
being synthesized respectively at the image/synthesizing step to produce a synthetic 
brightness signal and a synthetic color signal, respectively; 

the synthetic brightness and cok>r signals being compressed respectively at 
the image compressing step to profluce a compressed brightness signal and a 
compressed color signal, respectively; and 

the compressed brightness and color signals being compensated at the level 
compensating step to proyikice a compensated compressed brightness signal and a 
compensated compressed color signal, respectively. 

17. The method d set forth in Claim 16, wherein at the level compensating step: 
a compensation amount is calculated based on the compressed brightness 

signal separated^ at the signal separating step; 

the level of the compressed brightness signal is compensated with the 
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compensation amount to produce a compensated compressed brightness signal', and 

the compensated compressed color signal is produced based on the 
compensated compensated brightness signal. / 

1 8. The method as set forth in Claim 16, further comprising ^ie step of mixing 
the compensated compressed brightness and color signals. / 

19. An image pickup apparatus adapted to produce a single image excellent in 
gradation reproducibility from a plurality of images acquired by sensing an object 
under different exposure conditions, the apparatu/ comprising: 

means for sensing an object under different exposure conditions to acquire a 

plurality of images; / 

means for compensating the levels of the plurality of images on the basis of 
the exposure conditions under wrydh they have been sensed respectively, to provide 
a plurality of compensated images; 

means for synthesizing the plurality of compensated images to produce a 
single synthetic image having a wide dynamic range; and 

means for compressing the synthetic image to an extent depending upon the 
performance of it/ output destination to produce a compressed image. 

20. The apparatus as set forth in Claim 19, wherein the level compensating 
means comprises means for subtracting from the pixel level of each of the plurality 
of image/a positive value given based on the exposure condition under which each 
of the images has been sensed to produce the compensated image. 
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2 1 . The apparatus as set forth in Claim 20, wherein the level compensating 

means comprises: / 

means for calculating a mean pixel value of each of the pluralit/of images; 

and / 

means for multiplying the mean pixel value provided bWhe mean calculating 
means by a factor set based on the exposure condition to cal/ulate a positive value. 

22. The apparatus as set forth in Claim 2 1 , wherein the/level compensating 

means comprises: / 

means for time-smoothing the positive valu/provided by multiplying means; 

and / 

means for subtracting the time-smoothed positive value from the pixel level 

of each of the plurality of images. / 

23. The method as set forth in CJ&m 2 1 , wherein the factor is set larger for the 
image having been sensed with artarger exposure by the image sensing means. 

24. The apparatus as set fizfrth in Claim 20, wherein the level compensating 
means comprises: / 

means for allowihg to pass the signal of each of the plurality of images 
through a predetermined low-pass filter; and 

means for inultiplying an output of the signal filtering means by a factor set 
based on the exposure condition under which the image has been sensed to 
calculate a positive value. 
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25. The apparatus as set forth in Claim 24, wherein the level compensating 
means comprises means for time-smoothing the positive value provided/by the 
multiplying means; 

the subtracting means subtracting the time-smoothed positive value from the 
pixel level of each of the plurality of images. 

26. The apparatus as set forth in Claim 24, wherein tfie factor is set larger for 
the image having been sensed with a larger exposur/by the image sensing means. 

27. The apparatus as set forth in Claim 19, wjferein the image sensing means 

is adapted to output an image signal in which/a frequency-modulated color signal is 
superposed on a brightness signal, the apparatus further comprising means for 
separating the image signal into the brightness and color signals; and 

the level compensating mean/compensating the brightness signal and color 
signal separated by the signal separating means to produce a compensated 
brightness signal and a compensated color signal, respectively; 

the signal synthesizing means synthesizing the compensated brightness and 
color signals to produce/a synthetic brightness signal and a synthetic color signal, 
respectively; and 

the image c/mpressing means the synthetic brightness and color signals to 
produce a compressed brightness signal and a compressed color signal, 
respectively y 

28. The/apparatus as set forth in Claim 27, wherein at the level compensating 
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means calculates a compensation amount based on the brightness signal separated 
by the signal separating means, compensates the level of the brightness with/the 
compensation amount to produce a compensated brightness signal, and hzfroduces 
the compensated color signal based on the compensated brightness signal. 

29. The method as set forth in Claim 27, further comprising refeans for mixing 
the compressed brightness and color signals. / 

30. An image pickup apparatus adapted to synthesize/plurality of images 
acquired by sensing an object under different exposure conditions to produce a 
single image excellent in gradation reproducibilij^, the apparatus comprising: 

means for sensing an object under different exposure conditions to acquire a 
plurality of images; / 

means for synthesizing the plurality of^ompensate^images to produce a 
single synthetic image having aXide dynamic range; 

means for compressing the dynamic range of the synthetic image to an 
extent depending upon me performance of its output destination to produce a 
compressed image; and 

means for fltompensating the level of the compressed image to provide a 
compensated compressed image. 

3 1 . The apparatus as set forth in Claim 30, wherein the level compensating 
means comprises means for subtracting a predetennined positive value from each 
pixel \/vel of the compressed image to produce the compensated compressed 
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image. / 

32. The apparatus as set forth in Claim 31, wherein the level compensating 

means comprises: / 
means for filtering the signal of the compressed image; / 
means for normalizing an output value provided by the^ignal filtering 

means; and / 

mans for multiplying the output provided by the/normalizing means by a 
predetermined factor to calculate a positive value. / 

33. The apparatus as set forth in Claim 32, wherein the level compensating 
means comprises: / 

means for time-smoothing the positive value provided by the multiplying 

means; and / 

means for subtracting the/une-smoothed positive value from each pixel level 

of the compressed image. / 

34. The apparatus as set forth in Claim 30, wherein the image sensing means is 
adapted to output an image signal in which a frequency-modulated color signal is 
superposed on a brightness signal, the apparatus further comprising means for 
separating the in4ge signal into the brightness and color signals; 

the signal synthesizing means synthesizing the brightness signal and color 
signal separated by the signal separating mean to produce a synthetic brightness 
signal an<a a synthetic color signal, respectively; 
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the image compressing means compressing the synthetic brightness smd 
color signals to produce a compressed brightness signal and a compressed color 
signal, respectively; and / 

the level compensating means compensating the compressed brightness and 
color signals to produce a compensated compressed brightness signal and a 
compensated compressed color signal, respectively. / 

35. The apparatus as set forth in Claim 34, whereir/the level compensating 
means calculates a compensation amount based on/the compressed brightness 
signal separated by the signal separating means' compensates the level of the 
compressed brightness signal with the compensation amount to produce a 
compensated compressed brightness signal, and produces the compensated 
compressed color signal based on ttfe compensated compressed brightness signal. 

36. The apparatus as set forthin Claim 34, further comprising means for mixing 
the compensated compressed brightness and color signals. 

37. An image processing method of synthesizing a plurality of input images 
acquired by sensing a/ object under different exposure conditions to produce a 
single image excellent in gradation reproducibility, the method comprising the steps 
of: / 

receiving a plurality of images acquired by sensing an object under different 
exposure Conditions and compensating the levels of the plurality of input images on 
the basis of the exposure conditions under which they have been sensed 
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respectively, to provide a plurality of compensated images; / ' 

synthesizing the plurality of compensated images to product a single 

synthetic image having a wide dynamic range; and / 

compressing the synthetic image to an extent depending upon the 

performance of its output destination to produce a compr/ssed image. 

38. The method as set forth in Claim 37, further comprising the step of 
subtracting from the pixel level of each of the plurality of input images a positive 
value given based on the exposure condition unjfcr which each of the images has 
been sensed to produce the compensated image. 

39. The method as set forth in Claim 38; further comprising the steps of: 
calculating a mean pixel value of^ach of the plurality of input images; and 
multiplying the mean pixel vajue obtained at the mean calculating step by a 

factor set based on the exposure condition to calculate a positive value. 

40. The method as set fortryin Claim 39, further comprising the steps of: 
time-smoothing the p/sitive value obtained at the multiplying step; and 
subtracting the tkne-smoothed positive value from the pixel level of each of 

the plurality of input images. 

4 1 . The method Js, set forth in Claim 39, wherein the factor is set larger for the 
input image having been sensed with a larger exposure at the image sensing step. 

42. The metltod as set forth in Claim 38, further comprising the steps of: 
filtering the signal of each of the plurality of input images by a 
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predetermined low-pass filter; and / 

multiplying an output obtained at the filtering step by a factor setbffeed on 
the exposure condition under which the image has been sensed to emulate a 
positive value. / 

43. The method as set forth in Claim 42, further comprising the steps of: 
time-smoothing the positive value obtained at the^riultiplying step; and 
subtracting, at the subtracting step, the positive value obtained at the time- 
smoothing step from the pixel level of each of th/plurality of input images. 

44. The method as set forth in Claim 42, wherein the factor is set larger for the 
input image having been sensed with a larger exposure at the image sensing step. 

45. The method as set forth in Claiui 37, wherein each of the plurality of input 
images acquired at the image sensing step is an image signal in which a frequency- 
modulated color signal is superposed on a brightness signal, the method further 
comprising the step of separating the image signal into the brightness and color 

signals; and / 

the brightness signal and color signal separated at the signal separating step 
being compensated at the level compensating step to produce a compensated 
brightness signal and a compensated color signal, respectively; 

the comp/nsated brightness and color signals being synthesized at the image 
synthesizing s/ep to produce a synthetic brightness signal and a synthetic color 
signal, respectively; and 

/ 93 



the synthetic brightness and color signals being compressed at the image 
compressing step to produce a compressed brightness signal and a compressed 
color signal, respectively. / 

46. The method as set forth in Claim 45, wherein at the level/ompensating step: 
a compensation amount is calculated based on the brightness signal 

separated at the signal separating step; / 

the level of the brightness signal is compensate^ with the compensation 

amount to produce a compensated brightness signal; and 

the compensated color signal is produced based on the compensated 

brightness signal. / 

47. The method as set forth in Claufi 45, further comprising the step of mixing 
the compressed brightness and color signals. 

48. An image processing memod of synthesizing a plurality of input images 
acquired by sensing an object under different exposure conditions to produce a 
single image excellent in gradation reproducibility, the method comprising the steps 

of: / 

receivingyd plurality of images acquired by sensing an object under different 
exposure conditions and synthesizing the plurality of input images to produce a 
single synmetic image having a wide dynamic range; 

Compressing the dynamic range of the synthetic image to an extent 
depending upon the performance of its output destination to produce a compressed 
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image; and 

compensating the level of the compressed image to provide a compensated 
compressed image. / 

49. The method as set forth in Claim 48, further comprising the step of 
subtracting a predetermined positive value from each pixel leve/ of the 
compressed image to produce the compensated compressed image. 

50. The method as set forth in Claim 49, further compulsing the steps of: 
filtering the signal of the compressed image by A predetermined low-pass 

filter; / 

nonnalizing an output value obtained auhe signal filtering step; and 
multiplying the output obtained at the normalizing step by a predetermined 

factor to calculate a positive value. / 

5 1 . The method as set forth in Claim 50, further comprising the steps of: 
time-smoothing the posifrve value obtained at the multiplying step; and 
subtracting, at the subtracting step, the time-smoothed positive value from 

each pixel level of the compressed image. 

52. The method a^set forth in Claim 48, wherein each of the plurality of input 
images acquired at the image sensing step is an image signal in which a frequency- 
modulated color signal is superposed on a brightness signal, the method further 
comprisuVthe step of separating the image signal into the brightness and color 
signalsi/and 
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the brightness signal and color signal separated at the signal separating step 
being synthesized respectively at the image synthesizing step to produce a^ynthetic 
brightness signal and a synthetic color signal, respectively; / 

the synthetic brightness and color signals being compresse^respectively at 
the image compressing step to produce a compressed brightness signal and a 
compressed color signal, respectively; and / 

the compressed brightness and color signals being compensated at the level 
compensating step to produce a compensated compressed brightness signal and a 
compensated compressed color signal, respectively. 

53. The method as set forth in Claim 52y<vherein at the level compensating step: 
a compensation amount is calculated based on the compressed brightness 

signal separated at the signal separating step; 

the level of the compressad brightness signal is compensated with the 
compensation amount to produce a compensated compressed brightness signal; and 

the compensated compressed color signal is produced based on the 
compensated compensated brightness signal. 

54. The method a/set forth in Claim 52, further comprising the step of mixing 
the compensated ^ompressed brightness and color signals. 

55. An image processing apparatus adapted to produce a single image excellent 
in gradation/eproducibility from a plurality of input images acquired by sensing an 
object under different exposure conditions, the apparatus comprising: 

/ 96 



means for receiving a plurality of input images acquired by sensing an object 
under different exposure conditions and compensating the levels of the plurality of 
input images on the basis of the exposure conditions under which they h^ve been 
sensed respectively, to provide a plurality of compensated images:/ 

means for synthesizing the plurality of compensated images to produce a 
single synthetic image having a wide dynamic range; and / 

means for compressing the synthetic image to an extent depending upon the 
performance of its output destination to produce a compressed image. 

56. The apparatus as set forth in Claim 55, wherein the level compensating 
means comprises means for subtracting fronythe pixel level of each of the plurality 
of input images a positive value given bas^d on the exposure condition under which 
each of the input images has been sensed to produce the compensated image. 

57. The apparatus as set forth iiyClaim 56, wherein the level compensating 
means comprises: / 

means for calculating 6 mean pixel value of each of the plurality of input 

images; and / 

means for multiplying the mean pixel value provided by the mean calculating 
means by a factor sat based on the exposure condition to calculate a positive value. 

58. The apparatus as set forth in Claim 57, wherein the level compensating 
means comprises: 

mean/ for time-smoothing the positive value provided by the multiplying 



97 



means; and / 

means for subtracting the time-smoothed positive value from the pixel level 

of each of the plurality of input images. / 

59. The method as set forth in Claim 57, wherein the factor^ set larger for the 
input image having been sensed with a larger exposure by die image sensing means. 

60. The apparatus as set forth in Claim 56, wherein the level compensating 

means comprises: / 

means for filtering the signal of each of the/plurality of input images by a 
predetermined low-pass filter; and / 

means for multiplying an output of the signal filtering means by a factor set 
based on the exposure condition under/Which the image has been sensed to 
calculate a positive value. / 

61. The apparatus as set fortl/in Claim 60, wherein the level compensating 
means comprises means for ttoe-smoothing the positive value provided by the 
multiplying means; / 

the subtractingymeans subtracting the time-smoothed positive value from the 
pixel level of each M the plurality of input images. 

62. The apparatus as set forth in Claim 60, wherein the factor is set larger for 
the input ima^e having been sensed with a larger exposure by the image sensing 
means. / 

63. Tlte apparatus as set forth in Claim 55, wherein the image sensing means 
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is adapted to output an image signal in which a frequency-modulated color signal 
superposed on a brightness signal, the apparatus further comprising means^fjs 
separating the image signal into the brightness and color signals; and 

the level compensating means compensating the brightness signal and color 
signal separated by the signal separating means to produce a cornpensated 
brightness signal and a compensated color signal, respectively; 

the signal synthesizing means synthesizing the compensated brightness and 
color signals to produce a synthetic brightness signal/and a synthetic color signal, 
respectively; and 

the image compressing means the syndetic brightness and color signals to 
produce a compressed brightness signal and a compressed color signal, 
respectively. 

64. The apparatus as set forth ih Claim 63, wherein at the level compensating 
means calculates a compensation amount based on the brightness signal separated 
by the signal separating nyans, compensates the level of the brightness with the 
compensation amount to produce a compensated brightness signal, and produces 
the compensated color signal based on the compensated brightness signal. 

65. The method as set forth in Claim 63, further comprising means for mixing 
the compressed brightness and color signals. 

66. An image processing apparatus adapted to synthesize a plurality of input 
images acquired by sensing an object under different exposure conditions to 
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produce a single image excellent in gradation reproducibility, the apparatus 
comprising: / 

means for receiving a plurality of images acquired by sensing an object 
under different exposure conditions and synthesizing the plurality of input images 
to produce a single synthetic image having a wide dynamic range; 

means for compressing the dynamic range of the synthetic image to an 
extent depending upon the performance of its output destination to produce a 
compressed image; and / 

means for compensating the level of the^compressed image to provide a 
compensated compressed image. / 

67. The apparatus as set forth in Claim 66, wherein the level compensating 
means comprises means for subtracting a predetermined positive value from each 
pixel level of the compressed image to produce the compensated compressed 
image. / 

68. The apparatus as set forth in Claim 67 5 wherein the level compensating 
means comprises: / 

means for filtering^ the signal of the compressed image; 

means for nomifilizing an output value provided by the signal filtering 
means; and / 

mans for multiplying the normalized output by a predetermined factor to 
calculate a posmve value. 
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69. The apparatus as set forth in Claim 68, wherein the level compensating 
means comprises: / 

means for time-smoothing the positive value provided by the multiplying 
means; and / 

means for subtracting the time-smoothed positive vaj&e from each pixel level 
of the compressed image. / 

70. The apparatus as set forth in Claim 66, further^omprising means for 
separating the image signal into the brightness and^olor signals; 

the signal synthesizing means synthesizing the brightness signal and color 
signal separated by the signal separating mean to produce a synthetic brightness 
signal and a synthetic color signal, respectively; 

the image compressing means compressing the synthetic brightness and 
color signals to produce a compressed brightness signal and a compressed color 
signal, respectively; and / 

the level compensating means compensating the compressed brightness and 
color signals to produced compensated compressed brightness signal and a 
compensated compressed color signal, respectively. 

7L The apparatus as set forth in Claim 70, wherein the level compensating 
means calculate/ a compensation amount based on the compressed brightness 
signal separated by the signal separating means, compensates the level of the 
compresse/f brightness signal with the compensation amount to produce a 
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compensated compressed brightness signal, and produces^the^compensated 
compressed color signal based on the compensated-compressed brightness signal. 
72. The apparatus as set forthJn-€Iauri 70, further comprising means for mixing 
the compensated C0m*pressed brightness and color signals. 
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